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JDIGI i AL PROJECTION EQUIPMr .N 1 A\i JX^CHNHQU^ 

REFERENCE TO PROVISIONAL APPLICATION 
5 This application is based on and hereby refers to U.S. Provisional Patent 

Application Serial No. 60/215,715, filed Juiy 3, 2000, having the same title as appears above 

FIELD OF THE INVENTION 
This invention relates generally to projection of images and more specifically 
10 to techniques and equipment for enhancing characteristics (mcluding but not limited to 
dynamic range) of images projected electronically through, typically, digital projectors. 



BACKGROUND OF THE INVENTION 
U S. Patent No. 5,386,253 to Fielding, incorporated herein in its entirety by 
1 5 this reference, discusses exemplary projection systems uiihzing one or more spatial light 
modulators (SLMs). As noted in the Fielding patent: 

Spatial light modulator devices include so-called "active matrix" devices, 
comprising an array of light modulating elements, or "light valves/* each of which is 
controllable by a control signal (usually an electrical signal) to controllably reflect or 
20 transmit light in accordance with the control signal A liquid crystal array is one 

example of an active matrix device; another example is the deformable mirror device 
(DMD) developed by Texas Instruments . . . 
See Fielding, col. I, 11. 13-21. Of course, yet other types of light ^'engines," or sources, exist, 
and various of them may be used in connection with the inventions described herein. 
25 Regardless of the type of light sources and modulators used, audiences 

frequently desire to see images high in detail and richness and low in objectionable artifacts. 
High resolution and image quality in particular faLiliMtes suspension of disbelief of an 
audience as to the reality of the projected images Mi^h quality indeed often is an important 
factor m the overall success of the motion piciiirc vlw in*; experience among todav's 
30 audiences. 

Producing these high-resolution ima.<ics is not without added cost, however. 
Imax Corporaiion. for example, the intended assig.icj ol [his application, utili/.es not only 
specialized cameras and projectors, but also sovcniv ir ill mieter, fifteen perforation fdm to 
increase ihc rc ,oiunon and quality orpr()|CCiv:u n^i liv ^ ( '( >nvcn'jonal eiccironic proicctor^ 
."5 (and cspectcti:> those utilizing ^LMs). h> cuiuiaN' l:. i.iall; carnot supply equivalent 
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(c^kit-'.K^r- in projected images. As 



:tronic projectors frequcjul^ fail lo furnish 
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Ihc d\namic range and overall brigiitness of images provided by large-format films. They 
nonetheiess may desirably (or necessarily) be employed to display non-film-based images 
such as (but not limited to) computer-generated graphics or material captured with electronic 

cameras. 

U.S. Patent No. 5,490,00*^ to Venkateswar, ct a!., also incorporated herein in 
Its entirety by this reference, details techniques purporting to enhance image^csolution in 
systems employing multiple SLMs. According to the Venkateswar patent, sub-images 
generated by different SLMs are simultaneously displayed such that some sub-images are 
spatially offset horizontally or vertically fron^ others. This results in partial superposition of 
the sub-images, with the offset supposedly allowing a two-SLM system (with each SLM 
having "x" pixels per row) to provide "a perceived quality approaching that of a system that 
generates a single image from an SLM havmg 2(x) pixels per row." See Venkateswar, coL 2, 
11 41-43. 

L\S. Patent No. 5,612,753 to Poradish, et al., additionally incorporated herein 
in its entirety by this reference, discloses alternative techniques for, purportedly, increasing 
brightness of projected images or extendmg the projected number of gray levels. Figure 1 of 
the Poradish patent illustrates a projection s>stem in which light from two sources is reflected 
toward separate lens systems and then focused separately on distinct color wheels. Light 
from each color wheel thereafter is reflected to an SLM (preferably a DMD) via a total 
internal reflection (TIR) prism, with each SLM modulating the light and directing it back to 
the associated TIR prism. As directed, the light is then transmitted by the prisms to lenses for 
projection onto a screen. See Poradish, col 3,11.6-39. In essence, therefore, the Poradish 
patent contemplates use of dual DMDs present in parallel paths existing from separate light 
sources to a screen. 

While the techniques of the Venkateswar and Poradish patents arguably might 
enhance the resolution of an image produced n> a digital projector, alone cither is unlikely to 
provide resolution consistent with that ot ia: L-c-format film. Enhanced resolution of images 
produced by digital projection systems thus tcmains a significant issue for those engaged in 
development of commeicial projectieni tiquipment. .Absent further advancement m this area. 
Viewing ofclectronicall) projected itiui^js iiia> remain less satisfying to public audiences. 

SUMMAr<\ 01 THE INVENTION 

fhc prc5cnt m\cnl!0[i ->cjk iw y o\ idc sul.i advance mcius b> .uidrcssing 
(k-iu^icnc ICS (^f ixpicalK (but no: no- -.^.miI jvclusiveK * clectroniL. SljV!-cni i!(nMn*; 
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pioicciors. It further docs so in a luoic eotuprchcnsiN c manner than heietol ^tc ..^ isidered, 
duempting to create equipment and technicjues capable of providing images or sufficient 
overall quality that they may be used in venues instead of, or in addition lo. traditional large- 
format fjim projectors without disturbing audience perception that the viewed images are of 
high quality. As noted above, this perception is a significant aspect of modern-day viewing 
experiences, at times helping determmc overall success among the public of particular motion 
pictures. 

Embodiments of the present invention utilize not only superimposition, but 
also tiling to effect improvements to resolution of digitally projected images. Tiling" 
describes the concept of joining two or more groups of images (or "sub-images") edge to 
edge, with each sub-image containmg onl> a fraction of the total projected image. Because 
each sub-image conveys only a fraction of the overall image, its resolution will be greater 
than if the sub-image conveyed the toral image itself. 

Difficulties exist in, aino[ig other things, blending the midges depicted at the 
1 5 edges of the tiled sub-images. Because abutting sub-images may result in the presence of 

seams visible to viewers, adjacent sub-images often are overlapped at their common edges to 
reduce the visibility of these seams. Mere overlapping of sub-images typically is insufficient, 
however, as the additive intensity of the images in the regions of overlap in some scenes 
likewise may be noticeable to audiences. General methods of reducing brightness in these 
20 regions typically include adjusting the images either electronically or optically; the latter 
method usually implemented using an opaque or reflective element placed in the beam of 
light. 

Embodiments of the present invention employ instead a pyramid prism both to 
tile separate sub-images and to provide the requisite decrease in intensity of the sub-images in 

25 their regions of overlap. The sides of the pyramid prism constitute the reflective surfaces that 
combine separate sub-images together, while the apex of the prism acts as a complementary 
knife edge which optically provides the fall-off in inrensitf needed for enhanced blending of 
ihe sub-images in their overlapping legions An additional advantage of u.sing the pyramid 
prism is that, by moving it forward tind backward relative to the optical a.xis of the projector, 

30 fine tuning of the size of the overlap re^Mons can be achieved. Yet another advantage of the 
p>ianiid prism as beam combmci is ihai it adinib use of a single pro|CLiion le:is. thus 
reducing cost and complexity of the overall svstem. Finally, to the extent seams exist in the 
nvctiap region, the lechriuiies o! the r-^cse'M ir.vention tend to poMtio:i .nch <eam^ ip the 
v^cniji oi'the pro I cot ion lens \Wie'c jhc: 'aiions arc lovvest 
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f 1 bo combined whh supcnmpoMtiofi it the li^^ht from 

complementary, otfset SLMs is combined into a single image and directed to one side ofthc 
p>ramid prism, while the fight from additional complementary, offset SLMs is combined into 
a single image and directed to the other side of the pyramid prism. 
5 In a two SLM system, for example, such a combination may be accomplished 

by a series of polan/jng beam splitters. One SLM is directed first to the transmissive face of 
a beam splitter, and then to the reflective face of a second beam splitter. Theother SLM is 
first directed to the reflective face of a third beam splitter and then to the transmissive face of 
the second beam splitter where the images of the two SLMs are combined. This arrangement 

10 of polarizing beam splitters overcomes a v^ell known defect of these devices which is that the 
polarizing action of either the reflection or transmission has a better extinction of the 
unwanted direction of polarization. By combining a reflection and a transmission for each of 
the SLMs the extmction that results is the same for each SLM while providing each SLM 
image with an orthogonal polarization with respect to the other. 

*5 If desired the resulting superimposed SLM images may be viewed with 

glasses with two polarizing lenses with orthogonal polarization. This causes the image of one 
SLM to be seen by one eye and the image of the other SLM to be seen by the other eye. In 
this case two images may be stereo image pairs, providing for stereoscopic, or "3D," 
projection, a result desirable or advantageous for some pictures. In this case the benefits of 

20 superimposition are lost, but the projector is now flexibly used for 2D projection with 

enhanced resolution from superimposition, or used for 3D projection with lower resolution 
but without additional equipment except for the polarizing glasses worn by the viewer. 

The combination of superimposition and tiling of sub-images provides high 
spatial resolution without significantly increasing system size, cost, or complexity. A system 

25 using four SLMs, each of 1280 x 1024 pixels, for example, arranges as two tiles, each 

composed of two superimposed SLMs. This arrangement results in a final screen resolution 
of approximately 1 SOU (vertical) x 2750 (honzonta!) pi\cL through one projection lens, atone 
presenting a substantial mcrcase in resolution. 

The present invention nevertheless contemplates further enhancement ofthc 

30 quality of projected images. Selected embodiments ot the invention may use additional 

SLMs as pre-nioduLuoi\ to improve the contrast, or d> name range, of the system. Ideally, 
two or more SI Ms ^\oulci be arranged so that there e.vists precise one-to-one correspondence 
of :heir pixels f \'Lh ^l Vl cu::ld be driven independesul bui !P. concert so that their d>[uinML- 
Kinge cnpahilitR s v> y .-m;) copMvne '-^ extend the rc^'iiti d\ ruimic range. Altcrnati vel\ a 
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coarser (i.e. utih le^^ le^olution) SLM may be u>eJ >is ilir ,ir.--jnodulator to enhance ihc 
- dynamic range of a group of pixels of the associated dounstream SLM. 

Some preferred embodiments of the invention employ a single-pixel pre- 
modulator (typically an SLM) adapted to improve the dynamic range of the entire 
5 downstream SLM. In operation, the pre-modulator would function to block light from the 
downstream SLM to darken its entire image and enhance the black levels of selected scenes 
The downstream SLM would retain its full dynamic range capability, but wotTld have as its 
input new illumination levels when appropriate or desired For scenes that are bright, the pre- 
modulator need not be activated; in which event normal brightness levels would be 
1 0 maintained. The pre-modulator thus may be used to adapt the projector to scene brightnesses, 
matching generally how the human visual system functions 

Yet additional features of the present invention include luminance 
compensation for selectively increasing the ilium mation levels provided by the downstream 
SLMs when, tor example, further overall scene contrast is desired. Compensation algorithins 
1 5 may particularly be useful when single-pixel pre -modulators are used, as the global pre- 

modulation they provide may occasionally diminish too much the input to the downstream 
SLMs. Finally, improved scene contrast additionally may occur through use of one or more 
masks for the superimposed, tiled images. These masks may be used effectively to block 
unwanted glare produced around the edges of the SLMs. In particular, when tiling of 
20 multiple SLMs is to occur, a secondary ''shading" mask may be employed in a plane axially 
defocussed from a relayed image for improved results. 

It thus is an object of the present invention to provide methods and equipment 
for enhancing characteristics (including but not limited to resolution, contrast, and dynamic 
range) of projected images, 
25 it IS another object of the present mvention to provide methods and equipment 

for performing such enhancement more comprehensively than heretofore considered, 
employing techniques uicluding (but again not limited to) either or both of superimposing 
and tiling sub-images. 

It IS a further object of the present -'ivcntion to provide methods and 
30 equipment for reducing visible seaming of tiled inia^c5 some methods beneficiall) utilizmg 
both the reHecuvc ^ul faces and the apex of n n\ -anuJ pri?a\ 

It also IS an object of the present uncuLion to provide methods and equipment 
for polaii/ing h^^h^ trojr r-tTsot light >ourco> n kI < ^-ni ^-m: -htj polarized images, whicli 
then be used ttl <Jcsi[cJ). K:r stereoscopic pk'1lc*jo;> 
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h i> an add no ^hjoct ofihe present iiucnlion to pwidc rechniques and 
equipment for ppojection in niiich one or more pre-modulators are employed to iYnprove 
contrast, or dynamic range, ot projected images. 

It is yet another object of the present invention to provide techniques and 
5 equipment in which one-pixel pre-modulators are utilized, with such equipment optionally 
including compensation algorithms for correctional purposes. 

It is, moreover, an object of the present invention to provide oTie or more 
optical masks to reduce glare around edges of and otherwise improve contrast of projected 
images. 

Other objects, features, and advantages of the present invention will be 
apparent to those skilled m the relevant art with reference to the remainder of the text and 
drawings of this application 

BRICr DESCRIPTION OF THE DRAWINGS 
^ ^ PIG- 1 A is a schematicized depiction of a first sub-image output from a first 

SLM. 

FIG. IB is a schematicized depiction of a second sub-image output from a 

second SLM. 

FIG. IC is a schematicized depiction of the second sub-image superimposed 
20 on the first sub-image to form a first composite image. 

FIG. i D IS a schematicized depiction of the first composite image tiled with a 
second, similarly created composite image to produce an overall projected image using 
techniques of the present invention. 

FIG. 2 is a schematicized diagram of components of an exemplary system of 
25 the present invention, which may be used to produce the image of FIG. ID - ' 

FIG 3 IS a schematicized diagram showing a pre-modulator, which may be 
employed as part ot the present invention. 

FIG 4 !s a ^chcrnallCl2ed diagram of a simplified optical relay system 
showing exemplary placement of an edge mask. 

FIG. 5 IS a schematicized diagram of the system of FIG 4 showing, as well, 
exemplary placemcni of a ?^lo uiaiv shading mask. 
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or i \\\A D DLSCRIPTIONOFTilC V\V[\GS 
FIG. 2 iltustraics components that ma> be urilized as part of or in connection 
with an exemplary projector (00 of the present invention. As shown in FIG. 2, projector 100 
may include first and second SLM sets I (comprising la and lb) and 2 (comprising 2a and 
5 2b), respectively, each of which may (but need not) comprise one or more DMDs. Likewise, 
although four SLMs are depicted (as elements ia, lb, 2a, and 2b) ni FIG. 2, fewer or greater 
numbers may be employed yet remain consistent with various of the techniqcres of the present 
invention. 

Also depicted in FIG. 2 are three polarizing beam sphtters 6, 7 and 8. The 

10 image of SLM la via relay lens 4 Is transmitted through polarizing beam splitter 8 and 

reflected by beam splitter 7 through second relay iens 9 to mirrored pyramid prism 10. At the 
same time the image of SLM lb via relay lens 5 is reflected by polarizing beam splitter 6 and 
transmitted through polanzmg beam splitter 7 through second relay iens 9 to mirrored 
pyramid prism tO. The two SLM images are combined in polanzmg beam splitter 7, with the 

1 5 one having an orthogonal polarization with respect to the other In each case polarizing beam 
splitters 6 and 8 provide a clean up" function to ensure that extmction of the unwanted 
polarizing component is achieved for both SLM images which is a requirement when the 
system is used for 3D stereoscopic image projection. 

The SLMs of each of sots 1 and 2 typically are complementary, with the 

20 optical output of one spatially offset (preferably) one-half pixel both horizontally and 

vertically with respect to the other. Thus, as each splitter 7 combines the beams of the SLMs 
of its associated set 1 or 2, the sub-image of SLM la effectively is superimposed on that 
provided by SLM lb (or vice-versa), and the sub-image of SLM 2a is .superimposed on the 
sub-image produced by SLM 2b (or vice-vcrsa). This relationship for a set 1 or 2 is depicted 

25 generally in FIG. IC, which illustrates the optical output of, for example, SLM la (see FIG. 
IB) superimposed on thai (see FIG. I A) of SLM lb. As clearly discernable from FIG. IC, 
such supenmposttion inciecd may enhance the resolution of (or brighten or increase dynamic 
range of) the composite miagc by providing additional image information in the pixel 
interstices of the images produced by etcher SLM of set 1 oi 2 

Once a^:nn. conventional relay optics 9 ma\ be used to convey the combined 
(superimposed) beams tj a fj ing mechanism, shown in FIG 2 as pvramid orism 10 Each 
combined beam impinges on a -eflcctive side of prism 10 m a manner permitting the apex of 
prism 10 to dampen the intensity »)frhe iliumination of the .ey <mi (^fihcii intended overlap 
Vhh permits pt'im iO io ^.uni^inc the compoMte beam> prodtico j [tied imasze 12 havnm 
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vvoM-b!oEK^vi ' -iMtv in the region of then ovcna[> Such image 12 mav then be passed 
projection lens i3 for projection onto a-screen or other suitable surface or object If desired, 
an edge mask ! 1 inay be interposed between prism 10 and lens 13 to reduce edge glare or 
other undesirable characteristics of tiled image 12 before it is projected. Although those 
5 skilled in the arr undoubtedly appreciate advantages available through use of the surfaces and 
apexes of pyramtd prism 10, different tiling mechanisms may be used instead without 
undermmmg other novel aspects of the present inventron. 

Relay optics 9 may also function to equalize magnification of the optical 
signals ot the two channels (one emanating from SLM set 1 and the other from SLM set 2) of 
1 0 projector 100 before the signals are projected through lens 13. Such function is especially 
important m ccnatn embodiments of projector 100, which may omit pyramid prism 10 m 
favor of other edge-blending mechanisms (placed either before or after lens 1 3 in the optical 

^ path). One alternative to prism 10 is a pair of mirrors, one for each optical channel of the 

projector i 00. In effect, the two optical paths are directed to separate mirrors (rather than 

g 1 5 prism 1 1 ) and thence through separate lenses (instead of the single lens 1 3 shown in FIG 2) 

g for projection onto a screen. In these embodiments, the tiled image is formed at the screen 

Q rather than within projector 100, 

^ FIG- 3 illustrates prc-modulator 24 that may be used as part of the present 

^ _ invention. Light 22 from lamp 2! and reflector 20 is directed by cold mirror 23 to pre- 

20 modulator 24. Noted earlier is that pre-modulator 24 can be an SLM, preferably (although 
jy not necessarily) a single-pixel device in some embodiments, utilized to improve the dynamic 

p ^^"g^ downstream SLMs. Light modulated by pre-modulator 24 may than travel through 

H integrating bar 25 and through illumination relay 26 to SLM 27. Such SLM 27 corresponds 

to either SLMs la and lb or SLMs 2a and 2b of FIG. 2. 
25 MG. 4 details exemplary placement of an edge mask, denominated 205, m a 

simplitied illustration of an optical relay system 200, Conceptually, system 200 ma\ be used 
to cieatc an intermediate image of an SLM (or other light source) in space beyond a pr-sm 
202 Cic.umL, ihc image in this location would allow the use of a rectangular mask (as mask 
205) to select only the rectangular active area of the SLM to pass to subsequent optical 
30 systems Th\% would effectively eliminate llie areas of the SLM illustrated by scatter and 

beam Mvjnil! The ovc^-ali effect would be to enhance ^>sLem contrast and control ine edL'c 
illumination cf^ibling successful tiling of separate SLM images 

As siio-Ai: ir f"IG 4 St \1 jsscmbiy 201 is attached to pr:sin 202 thiou'Jih 
\^h^. 1 'iuht t% .:irceicd low :u-a reLiy Icnx 20"^ An iniagc o\ the "^LM asscmbK is k;LJteJ Ji 
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numeral : Pdec mask 205 i:> lociMcd m pl.^ o\ image 204 and tunciions ir . \ ni narc 
edge glare around the whole ofche SLM 

Additional masks 205 typically cannot be introduced in the image plane, as 
they may clip the SLM image and reduce the resulting picture size. However, in parallel 
planes displaced from the image plane, it is possible to introduce a mask to affect only the 
illumination cones rather than the image size. Doing so permit modification of the imase 
illumination along the "overlap'' side so as to reduce the overlap intensity. 

In FIG. 5, a shading mask 206 has been introduced between relay lens 203 and 
SLM image 204. Shading mask 206 will chp the illunnination cone but should not affect 
image size. Rather, it \v[\\ affect the illumination distribution at the end of the image without 
affecting the distribution in other parts of the image. By positioning shading mask 206 at a 
particular perpendicular distance from the SLM image plane and optical axis, it is possible to 
create a dcfmed decrease in intensity at the end of the SLM image. 

The intensity variation can also be matched spatially with the mtendeJ overlap 
dimension of two adjacent images. A second adjacent image with an identical intensity fall 
off over the opposite overlap dimension can also be creased. If the two images are then 
overlapped by the defmed overlap dimension, the intensity should remain constant over the 
overlap region. 

Because the foregoing is provided for purposes of illustrating, explainmg, and 
describing embodiments of the present invention, further modifications and adaptations to 
these embodiments will be apparent to those skilled in the art and may be made without 
departing from the scope or spirit of the invention. For example, as noted above, the position 
of prism 10 relative to lens 13 may be mobile, thereby permitting further refinement of the 
size of the region of overlap of the beams forming tiled image 12. Pre-modulation, 
compensation algorithms, and image coding additionally may occur consistent with the 
invention, and the systems and numbers of components described herein may be scaled as 
appropriate to effect desired results Vet additionally, ferroelectric devices, liquid-cr\ sral 
displays (LCD), or otiier light sources oi valves nia\ be employed as necessary or licsTcd 
Finally in :.ome cases, onis green or luminance information might be superimposed 
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